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ABSTRACT 
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what th--^ public wants to know about vhe educational system regarding 
its context (historical/political, legal, economic, demographic, 
social, and technological); inputs (financial costs and 
expenditures); process (teaching performance); and student outcomes. 
The third section comments on mathodologies for keeping the public 
informed, such as committees of inquiry and ^standing committees, and 
discusses monitoring met^ods and their difficulties. Systematic 
national or statewide testing programs are costly, define literacy 
and numeracy in limited ways, and may have undesirable backwash 
effects. The Australasian Cooperative Testing Program (ACAP) uses a 
diagnostic approach to help teachers understand and improve 
individual students' performance. The final section outlines 
strategies for improving public education accountability: (1) 
improving the statistical base and its analysis; (2) improving the 
system review process; (3) operating the system using a research and 
development approach; and (4) monitoring outcome through testing. 
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What Is meant by Public 
Accountability of Education 



1. The demand for accountability. 

Eighteen years ago a disHnguished US educator asserted: 
The public has lost fcith in educatuKud instituHotis. V:e public has demanded 
that schools demonstrate that resouna are being used properly'. But this has 
meant far more than mere financial accounting to ensure that funds have not 
been dlegatty spent or embezzled. What is demanded instead is that schools 
demonstrate that outcomes are worth the ddlars investment provided by 
communities. In ^tort what has been called for is a system of educational 
accountability. (Alkin, 1972) 

Since then more and more States in the USA have adopted State-wide 
monitoring programs through which both student and teacher 
pertormance is assessed. 

In Australia, the signs of si;nllar trends grow. The former Labor 
Minister In Victoria, Mr Ian Cathie, commissioned a survey of 
numeracy and literacy levels of 10 and 14 year olds to be undertaken by 
the Australian Council for Educational Research in 1988. His successor, 
Caroline Hogg, in the months before this survey was undertaken said: 
We are going to spend a fair bit of time thb yerr trying to draw out questions 
of accountability. I reckon timt's something that schools and teachers and the 
Ministry hme not given enough thought to. We are a bit weak on tite 
accouniabdttyside. (Hogg, 1988) 

The Commonweallh Labor Minister, Mr John Dawldns, took a similar 
view when he claimed that we need to develop a method of reporUng to 
the nation on how well our sdiools are performing aninst established 
goals. 

Others have even more precise proposals. The Liberal Party Pdlicy in 
Victoria calls for testing of all students in Years 3, 6 and 10 and the new 
Liberal-National Party government in New South Wales will 
implementing a similar policy in 1989. 

Educators cannot stand apart from these developments or simply deciy 
all attempts to develop and implement accountability procedures as 
•educationally unsound*. It is essential that they join the <Uscussion and 
define forms of accountability that they judge to be educationally sound 
and publicly acceptable. 
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2. Scope of accountability 



Accountability isdcariy linked witli responsibility. As was mentioned 
earlier many institutions and individuals contribute to the education 
process - the media as well as the schools, parents and peers as well as 
teachers. Hovyever wlien public accountability in education is being 
discussed it b usually only the institutions created or rc|;ulated by 

S)vemments - schools and colleges, TAPE Colleges, Colleges of 
dvanced Education and Universities, which are held responsible and 
therefore accountable for outcomes. 

II is true that each institution and each individual educator could be 
considered as having an interested 'public' to which each is accountable 
but for the purpose of this paper discussion of public accountability %vill 
be confined to the schooling level (primary and secondary or K-12) 
which includes all of compulsory schooling and to 'system 
accountability of two types nannely: 

(a) ' national accountability: tu>w the schooling level systems, 

with Australia as the unit of analysis, can be seen as 
accountable; and, 

(b) State accountability: how the schooling system within a 
Stale or Territory can be accountable. 

"School or institutional' accountability and 'teacher* accountability are 
not the topics of this discussion. Individual schools and teachers are 
parb of the system but their specific audience is only a small part of the 
public in the sense the word 'public' is used in the phrase 'public 
accountability'. All educators are aware of how bodi Commonwealth 
and State government regulations and funding policies now influence 
the various levels of education - preschool, prinuiry, secondary, tertiary. 
The govemmenb therefore share responsibility for different aspecb at 
different levels and assigning responsibility al any level becomes a 
complex issue. Within any StaK^ or Territory there are non-government 
schools as well as govemment.schools, all of which are included in the 
discussion of the topic. 

Much of current rhetoric for accountability emanates from the world uf 
commerce and industry which values that particular type of 
accountability which is commonly applied to firms and industries, 
namely, one in which outcomes are expressed in economic terms only 
and firms and industries are judged by profib and share prices. 
Educators consider this purely economic model provides a simplistic 
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approach nol appropriate to education because it ignores important 
educational outcomes. From their knoivledge of evaluation 
methodology educators have learned to consider the importance of 
process and to judge on the basis of both intended and unintended 
outcomes in both the short and the long run. 

If this evaluation approach is applied to commerce and industry a 
difference picture of accountability emerges. How should the public 
evaluate the tobacco industry? It has been financially very profitable 
but also caused lung cancer, the costs of which have to be met largely 
from the public purse. How can the individual suffering be costed? A 
chemical company may be polluting nearby streams leading to public 
cost. A law firm may be offering taxation advice which, even if not 
illwal, is not serving the interest of the public. In a monopoly worlcers 
andf management may combine for their muhial benefit but at the 
expense of the public. Educators can accept an evaluation approach to 
education for public accountability but they are entitled to ask the 
business and commercial critics of schools to apply the same evaluation 
principles of public accountability to their business activities. 

At the same time it is possible for governments to assign to schools 
tasks which educators know cannot be achieved, certainly not by all 
children. Performarxe targets can be set which reflect political desires 
rather than educational realities. There is a tendency for the public to 
keep adding responsibilities to schools without corresponding 
reducHon in existing tasks. The profession needs to make dear its 
objections to such tasks. 

However, once it is accepted that education systems can and should be 
held accountable for those activities for which they have accepted or 
been assiened responsibilities through proper procedures tne key 
questions become: 

(a) To whom and for what is the system responsible and how 
do the individuals and institutions within the system 
discharge their responsibilities as components of the 
system? 

(b) How can the system provide the information iteeded by 
the public in a form that can tie understood and at costs in 
time and money that are acceptable to the public? 

Educators will recognise this clarification and data gathering procedure 
as a typical evaluation exerdse with multiple audiences. Once the 'to 
whom* question is considered it becomes dear that society — that is the 
public to whom any report is addressed — comprises many groups 
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with differing and sometimes conflicting inteiests which influences 
data eatherine and more particulariy interpretation and judgment. In 
broad terms the public's interest in the 'for what' issue can be covered 
by two questions: 

(a) How, within a given context, are the funds utilised ^nd to 
what purpose? Understanding the context is crucial to 
making judgments. Fund usage includes financial 
accountability, but encompasses also input, such as 
resources used; processes employed; anid outcomes, both 
intended and unintended. 

(b) how well do the outcomes meet the immediate and future 
needs of the society where needs in this context are seen 
as being social as well as purely economic? This is the 
judgmental task. 

Since the provision of information — its collection and interpretation — 
costs time and money, which could alternatively be used in the 
educational process, a trade off is necessary. The type of information 
gathered and its use has to be examined critically and justified. There is 
no point in gathering huge amounts of data which serve little or no 
useful purpose. 

Australian education operates in a context of rap^d changes — political 
demographk, technological, economic and soda! changes. Schooling 
systems are expected to adjust to these changes. Before the public 
passes judgment, it (teeds to understand the contextual situation and 
the reasons for the responses to change made by those with educational 
responsibility. It is at this point that the current political structures and 
the roles and responsibilities of key individuals and groups in the 
system needs to be understood if accountability is to be linked with 
responsibilitv. While it would he possible to examine all the numerous 
responsibilittes of individuals in the education system for the purpose 
of this paper - the roles of individuals of three key levels will be 
considered: 

(a) the Minister; 

(b) senior system administrators — led by the 
Director-General or the Chief Executive Officer in the 
Ministry; and, 

(c) the principal and tecchers at school level. 

Since the legal, the main financial and most operational decisions are 
the province of the States the responsibilities of key individuals in the 
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state system will l>e examined first. Later their responsibilities as 
relate (o national system will tie discussed. 



3. R3sponsibilities of a State Minister of 
Education 

In Australia Stages have the consHtutional and major financial 
responsibility for schooling. The responsibilities of State Ministets of 
Education include: 

(a) Interpret and seek to have implemented, government 
policy as it affects the education portfolio. This 
respofisibility poses several issues for accountability. 
Implementation of changes always poses problems and 
tnay become politically unpopular in which case the 
actions of the Minister are going to be evaluated primarily 
by political colleagues — the Premier, Cabinet, the 
government members and *he Party. This political 
responsibility represents a major issue In the provision to 
the puMic of relevant (i.e. reliable anv^ valid) information 
on which to evaluate the performance of the system. 
Favourable infonnation will be made public but 
unfavorable reports nruiy he suppressed or delayed. 
Implementation strate^^s raise Issues about the 
responsibility of the Minister and those of the 
Director-General or Chief Executive. TheTesMinistet" 
syndrome can operate in education. 

(b) Obtain and allocate resources to portfolio agencies. It is 
important to recognise, especially in the short run, that the 
State Minister has limited freedom to manipulate 
resources. Salaries of teachers and other staff occupy a 
large percentage of the budget, with Uie number and type 
of teachers unable to be changed rapidly. The 
Commonwealth also makes funds available, sometimes 
for prescril)ed purposes which may not agree with the 
priorities of a State but which are almost impossible not to 
accept politically. The existence of resource agreements 
between the Commonwealtii and tfie States is a significant 
change as these agreements embrace tfie rhetoric of 
accountability. 
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A major accountability issue here b it} obtain and 
understand the necessary information in context, 
especially the State/Conmonwealih context, so that any 
evaluation of resource allocation is related to real 
responsibility and cotttrol. 

Also any judgments about evaluation of resource 
allocation wiU reflect value judgments about adequacy 
and equity. In the Australian context interstate and, 
within limits, international comparisons may be useful. 
However madunery for this omiplex task is very limited 
and efforts at making between State comparisons are not 
always wekomed. 

Since the link between polkies and resources b a 
ministerial responsibility it is Ministers who must he held 
accountable if they announce programs, often acceptable, 
bui which fail or struggle aloi^ because adequate 
resources were not provided. 

(c) Check that portfolio agendes are operating effectively and 
efficiently within portfolio parameters. Here the Minister 
is in one sense acting on benalf of the public, to check that 
the svstem is operating effectively to achieve the goals of 
the elected government The Minister is also protecting 
himself/herself. 

The Minister obtains feedlMK:k on the system from many 
sources — sentor staff, review conunittees, task forces, 
coitsultants, research braiirhes, pressure groups. From an 
accountability perspective how much of mis information 
should be nttdepuDlic? Major reports liy committees of 
inquiry such as Beazley (W A) Blackburn (Vicl and 
Keeves (SA), are published. This methodology as a form 
of publk: accountability will be commented on later. 

(d) Foster coordiruition and cooperation between portfolio 
agendes and also with related departments, '^le system 
has many parts and if the component parts of a system are 
not woiking together harmorJously the system suffers. 
Recent years have seen various structural changes in State 
systems in an e.ideavour to strengthen coordination and 

> jeration. It is difficult for the public to obtain 
evideiK» on how effective ttie existing structures were and 
whether the changes have improved or will improve the 
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situation, espedal!y if key officials are not committed to or 
do not understand the reasons for the changes. The 
committee of Inquiry by an 'expert' panel is one way of 
creating information for the public on the coordination of 
parts of the system. 

(e) Development of new policies and programs and the 

modification of existing policies and programs. Obviously 
the Minister does not do this alone but uses the 
professional staff of the system as well as political 
advisors and party conrunittees. But it is the responsibility 
of the Minister to see that policies are articulated to the 

EuUic. The public is better served now than in the past 
ut there is no tradition in Australia of strong debate on 
educational issues. The current debate on tertiary 
education v^th its Green Paper /White Paper approach 
has at least developed live*y public discussion in academic 
circles. At State level the niedia maintains only a modest 
interest in most educational issues unless they are 
sensational. 

No procedures for public accountability in education can be satisfactory 
if they focus on 'outcomes' alone. The State systems operate in a context 
and it is in that context the Ministers of Education have their 
responsibilities for which they should be held accountable. To judge 
them appropriately the public requires information it seldom possesses. 



4. Responsibilities of Icey administrators 

The term key administrators covers a range of important staff whose 
roles and responsibilities have been changing in response to structural 
alterations in the education system. In flie last few years there have 
been several shiits of key staff upwards, sideways, early resignations 
and even an appointn><^nt ain) its withdrawal by the next Govemrient 
before the offlcer (Director-General NSW) assumed office. These 
changes have occurred in most States and in the Conunonwealth 
portfolio and include replacing educators with professional 
administrators. The reasoi\s for such changes deserve study and 
comment in any attempts at public accountability since they raise issues 
about the responsibilities of Ministers vis-a-vis key adminifb'ators and 
are likely to erode public conRdence in the system. Administrators* 
O inaude: 



(a) Advisory role: Education will suffer if senior 
administrators are seen as mere managers on behalf of the 
Minister. There is a management role but debates about 
goals, input, process and outcomes in the context of both 
the State and the nation need professional input. A 
Minister will receive advice from nnany sources and senior 
administrators should expect to be judged for the quality 
of their educational advice. 

(b) Management and Coordination Role: Senior 
administrators have a number of extremely difficult tasks 
here. Programs initiated by the Comnnonwealth have to 
be integrated with State programs. Problems can arise 
between the management of the State schooling svstem 
and the State rules governing non*govemn)ent schools. 
There are statutoiy oodles (e.g. Year 11 and 12 
examination authorities) whose policies need to be 
consistent with those operating elsewhere in the schooling 
system. Interfaces have to be nuiintained with other parts 
of the total system, for example, TAPE and Higher 
Education institutions. 

(c) Operational Role: It is normally these senior 
aaministrators who are responsible for operating the 
government schools. In this role they need information 
m>m the schools as parts of the system to carry out this 
role. The information gathered can'be used also for 
accountability if it is made public. This issue is discussed 
later. It is worth notine that some procedures - inspection. 
State-wide testing imply litUe trust in the professionalism 
of ^?achers and inhibit diversity in the system. 

(d) Communication with the Public If the public is to develop 
trust in its education system then senior administrators 
must develop communication with the following groups: 

• The Minister, the Government and the Opposition. 
The Minister is directiy advised but it is important 
that both Government and Opposition understand 
educational options. This will help to prevent wild 
fluctuations in programs when Ministers or 
governments change. 

• The professionals operating tiie system. Where 
.major changes occur in curriculum or structures 
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making sure understanding occurs througlKiut the 
profession Is essential. If not, teacher stress is 
certain. 

• The public, and this includes parents, need to 
understand the reasons for change if they are lo 
accept them. 

One of the more appropriate methods of evaluating how well key 
administrators are discharging their responsibilities is the use of a 
committee of review methodology discussed hter. 



5. Responsibility of school and teachers 

This article is not concerned with the evaluation of a particular school or 
an individual teacher. However schor!3 and teachers are parts of the 
schooling system and, as such, evaluation information is needed on 
their performance as a group. Inspectorial systems of various types 
have been used for this purpose and are still supported l^y some 
members of the public. By structuring school coundls in an appropriate 
manner and by delegating to councils appropriate authority with 
suitable guidelines a form of accountability is created, especially if each 
council publishes an annual report. Systen«adc school reviews at 
tegular intervals with external as well $.s internal matters is aiK)ther 
method of ensuring quality for the whole of the parts. Information 
gathered from a sample of schools is adequate for evaluation of the 
system. Using a sample does not solve ihe problem of what data to 
^ther or tiie impact of the data gathering process on sdhools but a 
sampling approadi Is both less frightening to liKlividuals and less costly 
for tne public purse while still providing reliable information about tKe 
system. 

Also basic statistkral information can be gathered about a sample or 
about all schools which can he made public In addition to the usual 
statistics on .class size, pupil teacher ratio, otiier useful Information 
about inputs, processes and outcomes, staff development could be 
collated, analysed, discussed and published. 



6. Responsibilities within the notional system 

When the Commonwealth of Australisi was created as a federal system 
legislative responsibility for education n^ted with Ihe States but since 
then changes nave occurred. Since 1975 the Commonwealth has funded 



virtually all higher education and is now tn the process of reorganising 
higher education into a unified national system. The Commonwealth 
has also created a National Board of Employment, Education and 
Training and invests large sums uf Australian taxpayers hinds in both 
capital grants to schools and in educational programs via resource 
agreements. 

At the schooling level significant changes have occurred in the 
operation of such important national bodies as the Commonwealth 
Schoob Commission, Curriculum Development Centre, Education 
Research and Development Cbnmiittee. The Schools Commission has 
become part of the new National Board of Employment, Education and 
Training with less autonomy and, almost certainty, a lower proule in 
reporting on its activities to the public. CDC moved from being 
independent to being nart of the CSC and now seems likely to become 
independent again with joint Commonwealth-State control. ERDC was 
disbanded. It is important that the Australian Council for Educational 
Research Inc. retains its independence and continues to play a critical 
role in examining and publishing infovmation about educational issues 
in Australia. 

Does Australia have a body which can accept responsibility for 
develwing national goals and which can coordinate the activity of 
States-Territories as the operational components? If public 
accountability for the national system is to be achieved then It is 
essential to exanune the responsibilities of the Commonwealth for 
schooling and how tlie Conunonwealth Minister and Department 
discharge their responsibilities. Then in addition all tiie parts have to 
be evaluated as components of the whole. The Australian Education 
Council composed of aU tiw State Ministers and the Commonwealtii 
Ministo* is ihe only existing agency whom Uie public can hold 
respcr«^ole for ttiis. Since tiie CbminonwealUi Minister made a 
statement on national goals discussions have led to agreements for 

nter co-operation and shared responsibility for CDC. For machinery 
lay look to bodies like ACER but responsibility rests with tt\e 
Australian Education Council. 

Discussion questions: 

1. In any attempt at national evaluation how can the 
respective roles of tiie Conunonwealth and ti\e States be 
separated? Consider goals, input, process, outcomes? 

2. In what major ways does t^e role of tiie Conunonwealth 
Minister of Education differ from the State Ministers of 
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Education? How do these differences influence attempb 
to make each accountable to the public for his/her 
responsibilities? 

3. If national outconnes are measured using tests of literacy 
and numeracy what problems exist if States are compared? 
What about comparisons of types of schools such as 
Government, Catholic, Independent? 

4. How frequently %vould an individual school review be 
considered useful in terms of costs related to benefits? 
Who should conduct such a review? Should individual 
reviews be made public or only collated and analysed 
using a State sample? Is a report to the 'school 
community* sufficient? If so does this meet requirements 
for public accountability? 
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What does the public want to know 
about the education system — 
State and national 

1. Understanding the context 

In the opening paragraph of this paper is a quotation which states: 

Wfciit is demanded is thai schoob demonstrate that outcomes are worth the 
dollar investment provided. 

However any consideration of costs (dollar investment) requires an 
examination of how the funds are used - staff, buildings, equipment, 
programs. But making judgments about inputs, piocessw and 
outcomes requires an undersU.Hling of context. (Stuf flebean) 
In Australia the context (or education has changed marlcedly in the last 

1 u • ^"V"f "PP"*? '° 'ytem - schools and lertiaiy 

insHtutlons — it also applies to the educative processes taking place 
outside the formal system — for example, in families and through the 
media. 

When Ae formal system is being considered, many readers will 
remember a Hme when all formal instituHons of education were funded 
and or regubted by the Stales with no input from the Con-monweallK 
rn>e two TOTitory systems (ACT k NT) were funded by the 
uommonwealth but the operations carried out by the NSW and SA 
Education Departments.) Even now the major poliHcal parties of the 
Q)mmoi»wealth appear to differ about the role the Commonwealth 
shouW play in educaHon. Ministers also, even when they belong to the 
same party, can differ markedly in how they operate their department 
The changes that have ocrurred and are sliU occurring in Australian 
society have influenced the type of outcomes needed by society so 
outcomes must be evaluated in Uiat context 

Itb suggested that the following contextual factors are relevant to any 
serious attempt to evaluate either the naHonal or a State system of 
education: ^ 

(a) Hbtorical/politlcal context 

Change is inevitable and education systems need both to 
re^nd to and to anticipate changes. Evaluation of a 
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system requires attention to how it has coped with past 
diange and is planning to cope with future change. Any 
current atrtempt at an evaluation of the education system 
whether national or State would need to investigate the 
historical /political contex^. 

<b) Legal Context 

If accountability is linked with responsibility the legal 
context is extrennely important. What responsibilities at 
any time reside with the Conunonwealth Minister and 
what with the State? When national accountability is 
being considered is it a matter for Commonwealth alone or 
one for tiie AustiBlian Education Council? The AEC is a 
body composed of Sute and Territory Ministers and tiie 
Commonwealth Minister, who was only admitted to full 
mennbership in 1971 Collaboration through the AEC is 
not only inijportant for attempts at accountabili^ but also 
for implementing actions arising from accountability 
exercises. 

(c) Economic context 

Some understanding of the economic context of the nation 
and of the States is needed for makine judgments about 
resources devcted to educatton and their distributions to 
various levels — primary, secondary, tertiary and to 
govenunent and iK>n-gpvenunent systems. Before making 
judgments about the output of the systems account has to 
l7e taken of inputs and to the question of how well the 
outputs mesh with the economic needs of the country. 

(d) Demographic context 

Before any judgments are made about the national system 
or that of the States the demographic context needs to be 
understood. Comparison of costs between States have to 
take account factors such as size, location, ethnidty. 
Comparisons of costs and outputs over time must take 
account of demographic changes such as migration into 
and within a State leading to me need for new schools and 
new programs. 

(e) Social context 

States differ in tiieir sodal context and the expectations by 
tite'r public of ti^eir education ^tem. Queensland's 
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rejection of curriculum materials accepted by other Stales 
is a case in point. The variety of non-government scliools 
represent differing values. Again, such changes as smaller 
families, higher divorce rales, and increased participation 
of women in the pid workforce, have placed new 
demands on schooling and can affect the totality of 
outcomes. 

(0 Technological context 

Technological changes, such as computers, can influence 
input, process and output. Understanding the 
technological context both inside and outside the schools 
is important In evaluating any system. 

2. Understanding inputs 

Much information Is gathered on financial costs and how the funds are 
spent. Apart from the reports of the Ministers, information is gathered 
by the Australian Bureau of Statistics, the National Board of 
Employment, Education and Training and Its councils as well as other 

If the Commonwealth and the States arc to be held accountable for 
educational expendihires then Australia needs an efficient machinery to 
generate the necessary information. Does such machinery exist? Is the 
information readily available to the public? How should the 
information be presented? Who should analyse and Interpret it? 
Publication of between-States comparisons is seldom welcomed by the 
States. 

It is not the purpose of this paper to examine all the ways in which such 
quantitative data can be expressed In absolute terms or in the form of 
appropriate indices. What is certain Is that various pressure groups in 
the community will use the information to argue specific cases - too 
much, too little, wrong distribution. 

If the many reports from committees of Inquiry Into education over the 
last 20 - 30 years at national or State level were studied it should be 
possible for educators and representatives of the public to reach 
reasonable agreement about the input data needed for accountability 
and to devise a method of publishing it regularly in a form which the 
public can understand. The USA has a National Centre for Educational 
Statistics that publishes information of this kind. The Schools 
Commission made one valiant attempt at this. In the Australian context 



ERLC 



1^ 21 



it would seem to be a suitable task for the SeaeUriat of the 
Australian Education Coundl to collate and publish the necessary 
information. A case can also be nude for including some OECD 
information to help Australian citizens make comparisons with 
international data but the problem of differing contexts poses 
problems of interpretation. 

It is worth noting that most of the key decisions and therefore 
^^nsibilities associated with input and its distribution reside 

(a) the Minister and the Government; and 

(b) the senior administrators. 

With increasing devolution of responsibilities more decisions 
about less costly items are being made at school level. These 
decisions are important because they affect morale and process. 

3. Understanding process 

This is the area in which the public rightly expects the professional 
expertise of the educators to be demonstrated. Members of the public, 
especially taxpayers who pay taxes but have no diildren in schools, are 
well aware that more money is now spent on teacher education both at 
the pre-servtee and in-service levels comp red with what happened 
when they were at school. New technok>gies — computers, video 
cassettes — are common. Support staff — psychologists, speech 
therapists, sodai workers — are available. Cfonsiderable sums of 
money, although small as a percenUge of the budget, have been spent 
on educational research in Australia and overseas. When the increased 
hinds (input) are converted into actions (process) the public expects to 
see increased output. But given a changing social context this does not 
necessarily mean more of the same outcomes. 

In considering processes it is necessary to recognise that learning is not 
confined to the formal institutions and that external factors, such as the 
home and the nnedia influence what happens in schoob and the 
outcomes that accountability measures attempt to quantify. 
Processes must also be appropriate for the outcomes desired. Stress on 
rote learning and rigid discipline is unlikely to pnxluce independent 
individuals with skiUs in applying logical processes — a goal seen as 
important in a number of education reports and often mentioned by 
ernplo:^«rs. Thus clarity of goals is a desirable prerequisite for guiding 
input, directing processes and evaluating outcomes. This clarification dt 
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goals and processes requires dialogue I- ^tween the public and the 
professionals. 

Schools who communicate adequately with the parents of their pupils 
are iikety to satisfy this group within the public about process and 
outcomes. Unfortunately tor public accountability they are but a small 
section of the public albeit, according to public opinion studies, a more 
satisfied group. 

Research has a role to play in understanding how process is linked with 
outcomes but finding funds to foster research and to implement and 
evaluate changes to classroom practice arising from -esearch is a 
difficult task. Education is an activity which can utilise basic research 
from many disciplines but teaching oeing a practised activity carried 
out by individuals needs both Held testing and action research. 
Pre-service and in-service professional development needs to be valued 
by the public as well as by the profession. If the educators seek public 
acceptability as a profession it is necessary for them to communicate 
with the public about process and outcome. 

4. Understanding outcomes 

ExpectatUMS of schooling are many and there ts unlikely to be consensus at any 
but the highest levd of generality about the goals, aims and purposes which 
should be pursued by schools. Statements of goals are plentiful Most of these 
lay out the general principles that schools are concerned with knowledge and 
skins (learning) and values and attitudes (personal development). (Karmet 
19S3. p.68) 

Thet(! is a danger of using an industrial metaphor to conceptualise the 
outcomes of schooling, ^hools do not produce a uniform product in 
the way a car factory produces particular types of car, or a bakery 
produces types of bread where the unit for each type is a uniform 
product wnkrh can be readily quantified. Students are not moulded by 
schools but are active participants who help to shape their own 
outcomes. Shident satisfaction is a desirable outcome in itself. 

What then does the puWc want to know out th' outcomes of schooling 
and vhat information can be provided at reasonable cost. Schools have 
an important role in communicating about individual students to both 
the students and their parents. If this is well done it may meet the 
requirements of parents - a <4gnificant public group - but is unlikely to 
be seen as meeting the demands for public accountability. In a 
changing society eeneral competencies of the kind mentioned in the 
QERC report may be accepted as useful: 
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• acquiring information; 

• conveying information; 

• applying logical processes; 

• performing practical tasks as individuals; 

• performing practical tasks as members of a group. 

(KanneU 1985,p.7DfO 
The initial difficulty however is to agree on how these are to be assessed 
in a manner and at a cost which is acceptable to the public. What 
information? What logical processes? What practical tasks? What 
group tasks? Before assessment can be uncfertaken these general 
competencies need to be defined more precisely and agreement reached 
about suitable assessment instruments. 

Discussion questions: 

1 . What useful input measures couki be made available to the 
public re inputs at National and State/Territory levels? What 
use could be made of betwee- Stale comparisons, such as cost 
per pupil? What problems of interpretation and dangers exist 
from such comparisons? 

2. Can the public gain an understanding of process in schools or 
must they rely on the judgnnent of the professionals? What 
consensus about process exists in the profession? How should 
major curriculum char\ges be (a) generated (b) accepted (c) 
implemented? What is the role of the public and ot the 
profession in this process? 

3. How wouM you go about assessing the general compef j \cies 
outlined in the Karmel Report (listed above)? 

4. How useful are statistical tal>les relating to progression rates, 
subjects passed at Year 12. Which do you tfiink shouM be 
published regularly? 
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Comments on methodologies for 
keeping the public informed 

1. Committees of inquiry 

The Federal and Stale Governments have made frequent use of 
committees of Inoulry and will undoubtedly do so In the future. The 
^lue of this method of accountability for the public depends largely 

their memberahip, including their support staff; 

(b) their terms of reference; and 

(c) the time available. 

If the public wants the best lesults from this approach the followine 
principles are suggested: ^ 

(a) Membership largely external from the operation of the 
system being studied. Selfevaluationby parts of the 
system can contribute useful information but is not a 
substitute for external evaluation. 

(b) Professional competence of the committee. This 
competence applies to the group not to each individual. 
Thus an economist or a business person could be very 
useful on a committee but a committee comprising only 
economists or business people would not inspire public 
confidence. 

(c) Small rather than large. Once committee numbers reach 
double figures, communication within the conunittee is 
likely to suffer. 

d) Appointed rather than nominated and with individual 
members not seen as representing a particular pressure 

Soup. Politically based appointed pressure groups are 
«ly to be guided by self or group interest rather than 
public interest and comnwnly leads to cautious (lowest 
common denominator) reports. 

(e) Staffing. Skilled and experienced support staff »re needevi 
to find their way throueh the system — not always 
cooperative and helpful — to provide the infbnnation 
needed by the committee. Some of the information 
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needed can be handled by contract staff and or extenuil 
researchers but the committee staff have a vital role in 
collecting and interfyreting the information. 

(0 The interval between inquiries has to be guided by context 
but any period longer than a decade seems to ignore the 
rapidi^ of change. While committees of inquiry can be 
used to examine parts of a system, such as primary 
education, secondary education, teacher education, from 
time to time the public benefits from a look at the whole 
systekA. 



2. Standing committees or statutory bodies 

There have been a number of standing committees or statutory Ixxlies 
which have issued reporb which have an evaluative component and 
thus provided the public with information about the education system. 
Providing information at the national level were the Commonwealth 
Schools Commission and the Commonwealth Tertiary Education 
Commission. Both have now hem at>sorfoed into a new body tkie 
National Board of Employment, Education and Training with some 
apparent loss of those functions rdated to public accountaliUity. 

There have also been a variety of State bodies which have had 
evaluative and public reporting roles. A study of these would, I think, 
reveal they are not welcomed either by the Minister or the senior 
bureaucracy of the system and therefore tend to disappear or be 
muzzled and so fail to meet the public need for information. 

3. Mettiods of monitoring and ttieir difflculHes 

(1) Monitoring the context relevant to nuking judgments 
about educatton. Unless the professton understands the 
changing context, helps to shape it and responds to it, the 
public, trough the politica! process, is likely to fail to 
provide appropriate funds, be critical c5 the process and 
demand inappropriate or unattainable outcomes. 

(2) Monitoring inpub. It shoukl not be unduly difficult to 
monitor national and State inpub if agreement were 
reached '>n what is needed. Information on finances and 
eiuolnoents is already gathered by Ixxlies such as the 
Australian Education Coundl and the Australian Bureau 
of Statistics. 
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(3) Monitoring process. At the national or State system level 
It woufd be difficult Ir .nvisage any desirable 
nnelhodology By 
developing better communtcation between the school and 
i^communilvacontribuHonisnuKie. Major curriculum 
changes need to be communicated to the public as well as 
to the professionals. Inspection is an unacceptable 
answer. The English system of inspectors has been 
suggested. Systematic school reviews and regular peer 
evafuation need to be considered. What role can 
consultants play not only in helping teachers but in 
communicaHng to the public? If the public sees the 
profession taking adequate steps in professional 
development th^ are more likely to be satisfied, 
particularly if they are satisfied about outcomes. 

(4) Monitoring outcomes. When accountability is discussed it 
is often restricted to a discussion of monitoring a few 
outcomesw Such as literacy and numeracy - a simplistic 
response. However before examining specific procedures 
for nnonitoring outcomes (through for example regular 
testing) it is important to understand some of the 
problems associated with an outcomes monitoring 
approach. 

(a) Measured outcomes result from any factors 
operating independently - home, school media, 
community fodlities, self motivaHon - so it is 
impossible to isolate the contribution of the 
schools. What has been the impact of TV 
viewing on reading competency? What effect 
does the lar\guage of the home have on literacy 
as measured by tests in English? Monitoring 
may provide weak evkience that specific 
interventions have nuide an effect. The 
measurement of the Head Start program in the 
USA illustrates this point. 

(b) Monitoring outcomes, no matter how 
effectively it is done, does not provide 
information on how to improve outcomes for 
what is monitored. In economic^ the cost of 
living index maybe useful but it does not 
provide an answer to how to reduce inflation. 
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We know about aex differences in perfonranoe 
but know liltte about how to change the 
outcomes. Unfortunately much oTthe rhetoric 
about monitoring outcomes assumes the 

[)rocess of monitoring will by itself sonv^how 
mprove outcomes. 

(c) The outcome measures have to be examined 
for validity. There are two questions here: 

(i) Are all the important outcomes being 
measured? and, 

(ii) How vaUd are the instruments used as 
measures of the outcomes? 

Since not all desired outcomes can be readily 
assessed, administrative convenience tends to 
limit the monitoring prog^m to a few selected 
areas. Even then the instruments may be of 
doubthil validity. What does the public mean 
by literacv? b a short objective test of reading 
adequate? A test of minimum competence* may 
be useful for a particular purpose but 
* unsuitable for assessing tne range of 
performance needed for monitoring. 

(d) Changes in context may require changes in the 
measuring instruments making comparisons 
over time. The change to decimal currency or 
the introductton of calculators are but two 
examples of the changes that have affteted the 
assessment of numeracy performance over time. 



(e) Society's view of desirable outcomes nuiy also 
change over lime due to dumges in context e.g. 
computer literacy, competence in a language 
other than Lngltoh. This involves studying the 
balance of outcomes, not any singl^' outcome. 
Do we need more engineers and fewer teachers 
is a question that concerns the public. Since 
time at jchool is relatively constant chaims in 
time uevo: yl to one subject may lead to losses 
elsewhere. In one State a change in 
methodotogy seemed to lead to an 
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improvement in reading but a decline in 
spelling. Is this an acceptable outcome? 

(0 Some desirable outcomes take time to manifest 
themselves. Highly specific coach«ne may 
register what appears to be a desirable outcome 
for a Year 12 examination but not be a good 
preparation for higher education. Which is the 
outcome the public desires? 

(g) The process of monitorim may influence the 
outcomes in two ways. The outcomes being 
measured are seen by teachers and students as 
more important than those not monitored 
although this is not intended. Also the test may 
not be entirely satisfactory for the area being 
assessed, but the test shapes the learning of iUe 
students. Oracy for example, )f not tested as an 
aspect of literacy, may be ignored. 
It is therefore important to examine carefully the benefits and the 
problems before embarking on any system of monitoring outcomes. 
The time and money spent on monitoring has to be fudged against 
alternative uses of the hinds (input) such as hindine research and 
development — interventionist and /or action research — aimed al 
improving outcomes or on professional development of staff. 

4. Some comments on specific methods of 
monitoring 

(a) Examinations 

The public retains great hlih in statewide external public 
examinations but steadily this prop has been reduced. The 
writer sat for an external qualitving examination at the end of 
primary school (Year 7). In all States Year 12 assessments exist 
and the certificates are endorsed by some agency. 

However in some States (Qld, ACT) the examination is not 
external but school-based with some form of moderation. In 
other States external examinations and school-based 
information are combined. The results are widely used in the 
community for purposes such as selection for tertiary education 
and employment, these are decisions which affect the welfore 
of society as well as of the individual. 



ERIC 



22 

2ji 



The problems of comparability betwsen performances in 
different subjects and comparisons over time worry educators, 
especially those with technical competence in measurement, Init 
seem to be of little interest to the public. One frequently reads 
sutements about public examination results whidi assume 
constancy over time despite large changes in retention rates. 
Nothing in their design ensures such constancy. The Year 12 
examinations, however, provide useful information about the 
balance of the output from the schooling system, the 
percentage of students staying to Year 12 and the subjects 
studied are of public concern. The USA became very concerned 
when tests of the kind they use at Year 12 (the Scholastic 
Aptitude Tests) showed a decline in performance and their 
research has relevance to retention policies beine pursued in 
Australia. ^ 

(b) Tests specially constructed to monitor output 

Systematic national or statewide testing programs are costly 
and may have undesirable backwash effects. If testing is 
restricted to literacy and numeracy then an extremely limited 
picture of outcomes is provided. The tests used usually define 
literacy and numeracy in limited ways. The greatest danger is 
that the tests become the goal and define the curriculum. An 
alternative approach which provides and trains teachers to use 
diagnostic tests appropriately is more likely to help shident 
performance. 

The Australian Education Council began the Australian (now 
Australasian) Cooperative Testing Program, called ACAP, now 
carried on by the Conference of Directors-General, whose 
purpose is to develop and exchange ideas and materials relating 
to assessment for use by teachers. This essentially diagnostic 
approach can help teachers understand and improve the 
performance of individual students. This approach, if known 
and accepted, does not provide information tor public 
accountabi!ity but would create increased confidence in the 
profession and lessen the information about outcomes. 

Discussion questions: 

1. If teachers made better use of diagnostic tests and reported 
results to parents would it lessen the Jemand for external 
monitoring? Do teachers and/or parents also need access 
to normative test information? 
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I Would the tcsMng of general competencies lead to serious 
backwash effects? 

L How often. If at all should school reviews occur? What 
should be the composition of the review panel? 

I- Do we need a regular national review or do State reviews 
(committees of inquiry) meet the public need for national 
am)untability? How often do you feel such reviews are 
needed? 
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What can be done to Improve the 
public accountability of schooling 
In Australia? 

The interested public is helerogeneous %vilh different groups espousing 
different values and having differing expectations of its education 
system. This implies multiple audiences evaluating the information, 
consequently meclunisms for accountability can supply only some of 
the information about schooling ttie varied audiences could use to make 
judgments abou% the system - State or national. Wluit can be done, at 
acceptable costs, to improve the current situation? I believe the 
following are measures that can, and should be, implimented: 

1 . Improving the statistical data base 
and its anolysis 

The key body for devetoping a national data base incorporating 
information for the States and Territories is the Australian Education 
Council using its secretariat and working parties or through 
arrangements with other suitable bodies such as ABS and ACER. 
The data l>ase wouk) need to contain comparable information on input 
and distrilxition of resources, on output in broad terms - retention, 
graduation • aiul desirably survey information relating to satisfaction of 
participating groups • pupils, parents, emptoyers. 

The public then needs critical analysis of the data (trends, between 
States for example) carried out by independent bodies such as ACER or 
higher education staff. However, the greatest benefit would arise if the 
media employed educational commentators comparsd^le in numt)er and 
quality to the financial commentators now employed and who k)bbied 
to luive the basic data made public. 

2. Improving ttie system review process 

States/Territories will undoubtedly continue to use committees of 
inquiry/review and this process is likely to be more useful if certain 
procedures became accepted. 

(a) Regular - rather than ad hoc. A period not exceeding 10 
years would seem desirable. 
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(b) External rather than internal. It is desirable for the.review 
panel to hove a majority of its memlTers wiih no vested 
interest in the system, rhey can come from either outside 
the system or outside the State/Territory. 

(c) Balanced and expert. A group which contains a variety of 
expertise and experience. 

(d) Relatively small - Three to nine members facilitates 
conununication and discussion. 

(e) Research support. These researchers can be local and 
preferably know the system and its resources. 

(0 Access to school review data. This could be handled by 
(e) above but if the system had its own school review 
system a sairple of school data could be accessed. 

(g) Encourage self-evaluation exercises by components of the 
system as input. 

(h) Publish a report. Publishing first a draft before the final 
report can increase communication. When any national 
review is planned it should l^e organised by the AEC 
rather tlian initiated by the Comnnonwealth acting alone. 

3. Operating the system using an r & d 
approacti including publistiing of 
evaluation studies 

Major structural or curriculum changes, which will occur in any system, 
can be approached using formative and summative evaluation 
procedures to monitor the changes which occur. A lot wore could be 
done to make use of research staff in higher education institutions for 
this purpose and benefit the system, the participants in the program 
and the staff of the hidier education institutions who are engaged in 
teacher education. Publication of findings is essential. 



4. Monitoring of outcomes ttirougti testing 

Whenever ACER renorms existing tests or norms new tests it creates a 
pool of information about performance. This procedure tends to create 
lew problems. Opposition to monitoring by teachers usually exists 
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v/hen some regular testing program like the National Assessment of 
Education Progress (USA) is proposed. Unfortunately the public tends 
to see opposition by teachers as self protection. The public has little 
knowledge of costs, either educational or financial, and of benefits, 
often minimal. What then can the profession do to satisfy the public? 
Mention has been made of the ACAP approach which aims to improve 
the competence of teachers in assessment and communication to 
students and parents about progress. This helps pupils and parents but 
does not satisfy the wider public who want evidence that the system is 
meeting the needs of the wider community. The profession needs to 
propose a system of monitoririg in which the benefits, which include 
public confidence, exceed the costs. What would be some of the 
characteristics of such a system. 

(a) it would use a lieht sampling approach to minimise costs 
and backwash effects; 

(b) the groups to be tested would be ages which made the 
data meaningful. This woukl prot)abiy mean once in 
primary (say Year 4 or age tO) and once in secondary 
school (say year 10 or age 15 or the last year in compulsory 
scliooling); 

(c) the tests should relate to general competencies such as 
those recommended in the QERC Report and be 
constructed in consultation with both the public and the 
profession; 

(d) testing need not be frequent but must be regular to allow 
trends to be studied; 

(e) at the same time as the output data is gathered changes in 
process should be gatherea so that links between process 
and outcomes can be studied; 

(0 the results and interpretations should be made public. 

Because of the links between the political process and education there 
are risks for the profession in any monitoring scheme but the political 
risks of non-participatk)n seem greater • less professional autonomy and 
a loss of resource. 

Educators have responsibilities and must therefore expect to be 
accountable But public criticism based on inadequate information will 
merely serve to make teaching less attractive to ouali^ staff. Those 
presently engaged in schooling have a responsibility not only to 
themsehres but also to future memt)ers of the profession to lobby for 
accountability procedures whose 'l>ackwash* effects are not damaging to 
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